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Characterizations  of  Native  Spaces 


Lin-Tian  Luh 


Abstract.  In  the  theory  of  radial  basis  functions,  linear  combinations 
of  the  translates  of  a single  function  <f>  are  used  as  interpolants.  The  space 
spanned  by  all  of  these  linear  combinations  carries  an  inner  product  defined 
via  $ itself.  It  can  be  completed  and  becomes  a Hilbert  space,  called  the 
native  space  for  <h,  which  is  of  great  importance  for  further  investigation 
of  radial  basis  functions.  The  native  space  will  contain  abstract  elements 
which  are  not  linear  combinations  of  radial  basis  functions,  and  require 
some  work  to  be  recognized  as  functions.  This  paper  provides  some  char- 
acterizations of  native  spaces  and  relates  some  of  the  different  approaches 
used  to  define  them.  Finally,  embedding  results  for  native  spaces  into 
Sobolev  spaces  are  proven. 


§1.  Introduction 

Our  goal  is  to  describe  properties  of  the  set  of  functions 
N 

^ 1 Cj3>(j,  Xj ),  x € ft,  Cj  € C,  (1) 

3 = 1 

where  ft  is  a subset  of  ]Rd  and  $ is  a real-valued  symmetric  function  on 
ft  x ft.  These  functions  depend  on  sets  X = {x\, . . . , x^}  C ft  of  N pairwise 
distinct  points  called  “centers”,  while  the  number  N of  centers  and  their 
placement  within  ft  are  arbitrary.  Functions  of  the  form  (1)  arise  naturally  as 
tools  for  multivariate  approximation,  especially  if  $ is  a radial  basis  function 
${x,y)  :=  4>{\\x  — 1/II2)  with  a real- valued  function  <f>  on  [0, 00).  We  shall  study 
the  closure  of  the  linear  span  of  functions  (1)  under  a natural  topology  that 
comes  from  $ itself,  provided  that  $ has  a crucial  property: 

Definition  1.  A function  $ € C(ft  x ft)  is  called  conditionally  positive  definite 
(abbreviated  as  c.p.d.)  of  order  m on  ft  if  the  quadratic  form 

N 

^ ^ CjCk*^(Xj  , Xfc) 

j,k= 1 
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is  positive  for  all  sets  X = {x\ , . . . , C ft  of  N pairwise  distinct  points 
and  all  vectors  c = (ci, . . . , cn)t  £ CA  \ {0}  satisfying 

N 

CiP(Xi)  = 0 for  a11  Pm,  (2) 

i=l 

where  Pfn  is  the  space  of  d-variate  complex-valued  polynomials  of  order  not 
exceeding  m. 


There  are  various  possibilities  to  proceed  from  here.  Already  in  their  early 
pioneering  papers,  Madych  and  Nelson  already  took  two  different  approaches, 
via  finitely  supported  functionals  [3]  and  via  a specific  version  of  generalized 
Fourier  transforms  [4]  in  the  spirit  of  Gelfand -Shilov.  The  latter  requires 
measure-theoretic  arguments  at  certain  places,  and  is  rather  complicated  to 
deal  with.  The  dissertation  of  Iske  [1]  used  variational  inequalities,  while 
Weinrich  [6]  proceeded  via  regularized  distributions  in  the  sense  of  Schwartz. 
Our  goal  here  is  to  show,  as  far  as  possible,  the  equivalence  of  the  cited 
approaches.  Since  the  access  via  generalized  Fourier  transforms  has  problems 
in  dealing  with  arbitrary  domains  Cl  C ]Rd,  we  proceed  as  in  [5]  in  order  to 
start  with  the  most  general  approach  known  so  far. 

§2.  Construction  via  Finitely  Supported  Functionals 

Consider  the  space 

f N 

{Pm) n :=  j ^Cj6X(|  Cj  € C,  ®t  € ft  for  1 < i < N with  (2) 

'•t=i 

of  all  functionals  that  are  finitely  supported  in  ft  and  vanish  on  the  polynomials 
in  F™.  Starting  with  a c.p.d.  function  $ of  order  m in  ft,  we  define 

N M 

(A,p)$  := 

i=l  j= 1 

for  X,p,  £ {Pm)n  with  A = £)jLi  A^,  p = Ejli  hAj  to  get  an  inner 
product  (•,  •)$  which  induces  a ^-dependent  norm  in  the  ^-independent  space 
{P'rn)h.-  To  relate  functionals  with  functions,  we  use  the  map 

R*  ■ {Pi)h  - C(Cl),  R*{ A)  :=  A*$(z,  ■)  =:  A * $, 

where  Xx  stands  for  the  action  of  A with  respect  to  the  variable  x.  By  standard 
Hilbert  space  arguments,  the  fundamental  identity 


M-M A))  = (A,p)$  for  all  X,  p e {P^)q 


(3) 
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proves  that  (P„) q and  its  image  under  P$  form  a dual  pair.  Furthermore, 
this  equation  carries  over  to  the  Hilbert  space  closures  P$tn  of  (Pfn)ci  and 
P$, n of  i?$((Pm)n),  respectively. 

This  construction  is  simple,  but  it  leads  to  rather  abstract  elements  in- 
stead of  classical  functionals  and  functions.  To  overcome  this  problem,  one 
assumes  that  Pfn  and  ft  allow  a Lagrange-type  basis  Zi , . . . , lm>  with  m'  = 
dim  P‘l  and  points  x\, . . . , xmi  £ ft  such  that  k(xj)  = 8,j  for  1 < i,j  < m' . 
Then  the  functional  <5(x)  :=  8X  — h(x)8Xi  lies  in  (P„)q,  and  the  map  5$ 
with 

S<f,(fi)(x)  :=  (n,8(x))i j.  = 8(x)R<f,(n)  = p(R*(8(x)))  for  all  p £ P$,n,a;  £ ft 

uses  (3)  to  define  a classical  function  S$(p)  for  each  abstract  element  p £ P$,n- 
The  space  G$,n  :=  5<f>((P^,)^)  now  is  a much  more  concrete  space.  The  first 
of  our  results  can  be  found  in  [2]  with  full  proofs. 

Theorem  2.  The  spaces  n :=  R<s>(P<s>,n)  and  G$,o  :=  5$(P$,n)  are  iso- 
metrically  isomorphic  via  the  mapping  S&  o P^3  and  the  inner  product  it 
introduces  on  G^n.  Furthermore, 

p(S$(\))  = (\,p)*=p(Rz(\))  (4) 

holds  for  all  functionals  in  (P?n)n  and  its  closure  P$,n- 

It  is  not  straightforwardly  possible  to  associate  classical  function  values 
to  the  elements  P$( A).  But  (4)  indicates  that  P$( A)  and  S<f>( A)  should  agree 
up  to  a polynomial  from  P^  on  ft.  The  function  S$( A),  however,  vanishes  on 
the  points  we  used  for  the  Lagrange  interpolation  in  P^,  and  thus  realizes  a 
very  special  assignment  of  function  values  modulo  Pfn.  Thus,  we  can  interpret 
P$(A)  as  an  equivalence  class  of  functions  mod  P^  on  ft,  one  representer  of 
which  is  5$ (A).  Thus  we  should  add  P^  to  the  spaces  we  dealt  with  so  far. 

Definition  3.  Let  $ be  c.p.d.  of  order  m > 0 in  ft.  Then  the  direct  sum 

7V*(ft)  :=  P*  (ft)  © G*,o 

is  called  the  native  space  of 

The  above  construction  allows  us  to  define  a semi-inner  product  (.,.)$  on 
this  space  such  that  the  nullspace  is  P^.  Theorem  2 now  implies  the  isometric 
isomorphisms  iV$(ft)  = P^(ft)  © P$,n  and  iV$(ft)  = P^(ft)  © as  two 
characterizations  of  the  native  space.  We  add  two  others,  with  proofs  in  [2] 
dating  partially  back  to  [3]: 

Theorem  4.  Assume  ft  is  a subset  of  St d and  m > 0.  Then  7V$(ft)  is  the 
unique  subspace  of  G(ft)  with  a semi-inner  product  (•,  ■)$  satisfying 

(a)  the  null-space  of  the  semi- norm  is  Prd  (ft), 

(b)  7V$(ft)/P^(ft)  is  a Hilbert  space, 

(c)  if  p £ (P„)q,  then  p * $ £ N$(Q)  and  (p  * $,/)#  = p(f)  for  all  / £ 
AT*  (ft). 
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Theorem  5.  Fix  m > 0 and  a c.p.d.  function  $ of  order  m in  SI.  Then  a 
complex-valued  function  f on  0 is  in  iff  there  is  a constant  c(f)  such 

that 

Mf) I < c(/)||mIU 

for  all  p in  (P^) q-  The  smallest  possible  constant  for  such  f is  the  seminorm 

ll/ll*- 

The  following  sections  will  proceed  gradually  from  here  to  other  char- 
acterizations of  native  spaces.  The  main  guideline  is  the  various  forms  that 
functionals  can  take,  starting  from  finitely  supported  functionals  used  in  this 
section.  We  proceed  via  measures  (finitely  or  compactly  supported)  to  distri- 
butions, and  we  refer  the  reader  to  [2]  for  full  proofs. 

§3.  Construction  via  Measures 

Definition  6.  The  family  of  all  finitely  supported  measures  on  Q is  denoted 
by 

Theorem  7.  Let  m be  a nonnegative  integer.  Assume  $ is  positive  definite 
in  fi  with  the  following  property:  for  all  X e M( fl)  and  t > 0,  there  exists  pc 
in  (pm)ri  satisfying 

IK  - A||$  < £. 

Then  (P„)q  is  contained  in  and  M(fl)  is  isometrically  isomorphic  to 

a dense  subset  of  (P^)q.  Furthermore,  we  have 

Nt{n)  “ p£(n) 

where  the  closure  is  induced  by  $.  The  inner  product  on  M(Q)  is  defined  as 

:=  X(p  * $). 


Now  we  introduce  a new  space  {(P^)^)  consisting  of  all  compactly  sup- 
ported measures  p on  f l with  vanishing  moments  for  P^,  i.e.,  all  integrals  of 
polynomials  from  with  respect  to  p are  zero.  If  we  assume 


//*< 


x,y)dv{y)dp(x 


) = / / $(x,y)dp( 
Jn  Jn 


x)dv(y) 


for  all  p,  v in  ((P£)n),  and  

v{v  * $)  > 0 

for  all  nonzero  v,  it  is  easily  checked  that 


(v,p)  :=  v(p*$) 

forms  an  inner  product  on  {(Pm)n)-  Then  we  have  the  following  theorem: 
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Theorem  8.  Under  the  above  assumptions,  {{Pm) n)  JS  isometrically  iso- 
morphic to  (Pm) fj.  Furthermore,  the  native  space  i\f<j>(ft)  is  equivalent  to 

PM®((P*)&. 

The  proof  of  Theorem  8 in  [2]  is  quite  hard.  It  involves  weak*  topology 
and  the  Krein-Milman  theorem.  So  far,  Theorem  8 is  the  best  result  concern- 
ing interpretation  of  the  dual  of  the  native  space  as  a space  of  measures. 


§4.  Construction  via  Tempered  Test  Functions 

Starting  from  [4]  there  is  an  approach  to  native  spaces  via  generalized  Fourier 
transforms  in  the  sense  of  Gelfand  and  Shilov.  Here,  we  want  to  avoid  distribu- 
tions and  generalized  Fourier  transforms  as  far  as  possible.  The  key  point  is  to 
use  variational  equations  on  spaces  of  tempered  test  functions  as  a convenient 
substitute  for  generalized  Fourier  transforms. 

Let  <S(ft)  denote  the  space  of  tempered  test  functions  in  the  sense  of 
Laurent  Schwartz  with  supports  contained  in  ft,  and  define  5^  (ft)  as  the 
space  of  tempered  test  functions  with  support  in  ft  and  vanishing  moments 
up  to  order  m.  For  all  v,w  € <S^(ft) 


(v,w)i 


-n 

Jq  Jn 


y)v(x)w(y)dxdy 


is  a bilinear  form,  and  we  would  like  to  base  a second  construction  of  the 
native  space  on  it.  To  this  end,  it  would  be  a reasonable  possibility  to  define  a 
property  like  “tempered  conditional  positive  definiteness”  to  require  that  this 
form  is  positive  definite  on  (ft).  The  result  would  be  a different  theory, 
but  we  want  to  blend  this  approach  into  our  previous  setting.  Thus  we  look 
at  conditions  that  allow  to  relate  this  bilinear  form  to  the  earlier  one. 

Following  [1],  we  assume  a continuous  positive  function  ip  : R \{0)  — * 1R 
exists  such  that 


(v,w)*  = (27r)-d  [ <p(x)v(x)w(x)dx  (5) 

J Rd 

for  all  v,w  e <S^(ft).  Here 


denotes  the  classical  Fourier  transform  of  v.  By  approximation  of  functionals 
from  (Pm)n  by  regular  distributions  generated  by  functions  from  <S^(ft),  Iske 
[1]  proved  that  this  assumption  is  slightly  stronger  than  c.p.d.  of  $ on  ]Rd, 
and  that  (v,w)$  = (v,w)$  holds  for  all  v,w  € <S^(ft). 
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Definition  9.  If  a function  <f>  of  difference  form  $(x,  y)  = (f>(x  — y)  with 
a continuous  and  even  function  on  Rd  satisfies  (5),  we  call  $ variationa lly 
positive  definite  (v.p.d)  of  order  m > 0 on  Rd. 

Definition  10.  Let  $ be  v.p.d.  of  order  m > 0 on  Rd.  A complex-valued 
function  f is  in  the  space  C$im(fi)  if  and  only  if  f 6 C(fl)  and  there  exists  a 
constant  c(f)  such  that 

| f f(x)v(x)dx\  < c(/){  f f ^{x,y)v(x)v(y)dxdy}1^2  for  all  v £ <S^(f2). 

J n J q Jo 

Theorem  11.  Let  fl  be  open  and  $ be  v.p.d.  of  order  m > 0 in  Rd.  Then 
N$(ft)  = C$ifn(fi).  Furthermore,  is  isometrically  isomorphic  to  (P^) q. 

Theorem  11  provides  a nice  unification  of  the  theories  of  Weinrich  [6]  and 
Iske  [1].  Their  work  is  based  on  {P^)h.  anfl  respectively.  The  proof  of 

Theorem  11  is  rather  involved  [2]. 


§5.  Embedding  Theorems 

We  now  construct  continuous  embeddings  of  native  spaces  into  well-known 
spaces.  Madych  and  Nelson’s  discovery  that  N$(Rd)  C C(Rd)  can  be  re- 
garded as  the  first  step  towards  embedding  theorems,  but  it  was  just  an  in- 
clusion result.  In  this  paper,  all  the  embedding  theorems  concern  continuous 
embeddings  with  respect  to  the  topologies  of  the  spaces.  Even  the  embeddings 
of  native  spaces  into  L%  spaces  can  be  nontrivial,  provided  that  the  underlying 
domains  are  unbounded  (see  [5]  for  the  bounded  case). 

In  this  section  we  first  assume  $ to  be  v.p.d.  of  order  0 on  Rd  with  a 
positive  classical  Fourier  transform  <p  € L i(Rd)  of  cj)  with  $(x,y)  = (p(x  — y). 
All  functions  / of  the  form  (1)  have  a classical  Fourier  transform 

N 

i= i 

and  there  is  an  isometry  B : R$((Pq)q)  — > L2(Rd)>  / •-*  f / s/fp  mapping 
these  functions  into  Z<2(Rd)-  It  is  now  easy  to  see  that  the  equation  / = 
y/ip-  B(f)  holds  for  all  functions  in  f?4>((T,d)n)  and  its  closure  which  can 
be  identified  with  the  native  space  of  $. 

Theorem  12.  For  variationally  positive  definite  functions  on  Rd  of  order 
zero  with  a positive  L\  Fourier  transform  ip,  the  functions  in  the  native  space 
of  $ have  Fourier  transforms  of  the  form  y/fp  ■ g with  an  L2  function  g.  The 
native  space  for  $ can  be  continuously  embedded  [2]  into  Z/2(Rd)- 

The  last  statement  was  generalized  in  [2]  to 
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Theorem  13.  Let  $ be  symmetric  and  translation-invariant  on  ft  x and 
c.p.d.  of  order  m > 0 on  a domain  Q C Rd  containing  points  £i,...,£jv 
which  uniquely  determine  polynomials  of  P£(fl).  If  there  exists  a positive 
continuous  g £ L1((l)  which  decays  exponentially  at  infinity  and  satisfies 


I 

J Q 


\p(x)<f>(x)\g(x)dx  < oo 


for  all  p(x)  £ then  can  be  continuously  embedded  in  L2(fl). 

Theorem  12  characterizes  native  spaces  as  spaces  of  functions  whose 
Fourier  transforms  lie  in  a weighted  L 2 space.  The  same  holds  for  Sobolev 
spaces  on  ]Rd,  and  this  similarity  can  be  used  to  derive  theorems  for  embed- 
ding of  native  spaces  into  global  Sobolev  spaces  on  Itri.  For  embeddings  of 
local  native  spaces  on  domains  Q C ]Rd,  we  refer  the  reader  to  the  fact  (proven 
in  [2]  and  [5])  that  functions  in  native  spaces  always  have  an  extension  to  the 
largest  domain  where  $ has  the  c.p.d.  property.  This  yields  embeddings  of 
local  native  spaces  into  spaces  of  restrictions  of  global  Sobolev  spaces  for  glob- 
ally defined  functions  <I>,  but  the  case  of  purely  locally  defined  $ is  unsolved. 

If  $ is  v.p.d.of  positive  order  m on  3Rd,  the  function  ip  of  (5)  will  have  a 
singularity  at  zero,  and  thus  the  notion  of  Fourier  transforms  needs  generaliza- 
tion. We  simply  view  (5)  as  a variational  property  satisfied  by  the  generalized 
Fourier  transform  tp  of  d>,  and  we  want  to  prove 

Theorem  14.  For  v.p.d.  functions  $ on  ]Rd  of  order  m > 0 the  functions  f 
in  the  native  space  of  $ have  generalized  Fourier  transforms  f = • g with 

an  L2  function  g,  where  the  generalized  Fourier  transform  of  f is  defined  via 
the  variational  property 


J f ■ w = (27t)  d J f ■ w for  all  w € <Sd 


m 


Proof:  We  take  two  functions  v,  w £ Spp(  fl)  and  form  the  function  fv  :=  $*v. 
Then  (5)  yields 

J w • fv  = {2ir)~d  J ipuiv 

= (2ir)-d  J Wy/ipy/ipv  (6) 

= (270-d  J ™VvB(fv), 

if  we  define  B(fv)  :=  ^Jfpv  £ f 2(lRri)-  This  maps  isometrically  into  L2(lRd), 
because  the  canonical  inner  product  of  such  functions  is 

ifu,fv)$  = (2tt )~d  J puv. 


Now  (6)  carries  over  to  the  closure,  i.e.  the  native  space,  and  it  yields  the 
desired  result.  □ 
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